Package-level declarations

Types

Link copied to clipboard
class DiscoveryFailureReporter(logger: <Error class: unknown class>)

Reports a runner's discovery failures once per change, not once per attempt.

Link copied to clipboard

Declares that a named provider's models may appear AFTER startup.

Link copied to clipboard
data class LocalModel(val name: String, val kind: LocalModelKind)

A model a local runner is serving right now.

Link copied to clipboard

The three objects a local runner's autoconfiguration publishes, built over ONE catalog.

Link copied to clipboard
class LocalModelCatalog(source: LocalModelSource, discovery: LocalModelDiscoveryProperties, ticker: () -> Long = System::nanoTime) : LateArrivingModels

What a LocalModelSource is serving, cached for long enough that asking is not an HTTP round trip per embedding.

Link copied to clipboard
data class LocalModelDiscoveryProperties(var enabled: Boolean = true, var refreshInterval: Duration = Duration.ofSeconds(10), var missRefreshInterval: Duration = Duration.ofSeconds(1))

How often a local runner is re-asked what it serves.

Link copied to clipboard

Satisfies an embedding role with a model a local runner is serving RIGHT NOW.

Link copied to clipboard

What a model a local runner is serving is FOR.

Link copied to clipboard

Satisfies a chat role with a model a local runner is serving RIGHT NOW.

Link copied to clipboard

A local model runner - Docker Model Runner, LM Studio, Ollama - asked what it is serving NOW.